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ABSTRACT 

The. problei of Tariabilitj of data, even in 
presuiable hoiogenecus subgroupings of handicapped children, which 
contaminates the results of lany special education curricului 
evaluation Studies is exaiined with a study of 103 second-grade 
learning disabled students. The distortion of statistics calculated 
on saiples of extreie variability; coupled with polyiodality, 
skewedness, or kurtosis, is discussed, ^The case study. approach de 
offered as one way to help balance the presentation of results, aT 
exaiple is presented using standardized test data and longitudinal 
criteron- referenced wea^ureient data frofc both self-contained classes 
and resource rcois collected in 1971-1972, Approximately two-thirds 
of the report consists of tables and statistical data, (Author/IH) , 
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ABSTRACT 

A perennial problem that has contaminated the results of many special 
education studies has been the extreme variability of ""data, even in pre- 
sumably "homogeneous" subgroupings of handicapped children. Any statistics 
(such as the average) calculated on such samples is bound to be quite 
distorted. Extreme variability, coupled with poJLymodality , skewness, or 
kurtosis, of any type of group-average information very sbspect. The case' 
study approach is one way to help balance the presentation of results. 
While group-average data can still be reported, the specificity of the case- 
study approach forces the reader to hone in on the distribution problems that 
greatly restrict the generalizability of the group-average data. An example 
is presented using standardized test data and longitudinal criterion-ref erenced\ 
^leasurement data from both self-contained classes and resource rooms collected 
in 1971-1972 by the investigators from the Nati-onal Regional Resource Center 
of Pennsylvania, the predecessor of the^ current National Learning Resource 
Center x>f Pennsylvania. 
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INTRODUCTION 

t " ■ * ^ 



Previous reviews of accountability /problems in dealing with handicapped 
children (Proger 1971a; Proger, 1971b; Proger h Mann, 1973a; GTotslcy and 
Proger, igfs) have ffhown the enormity of the task of ^ring to unravel the ^ 
various gyrricular threads of what is^* really a complex "package." (Proger, 
Carfioli, & Kalapos, 1973). A special educatio^n teacher-'s efforts, even 
moreso than those of a regular education t,iacher, always involve an eclectic 
selection of instructional materials (alias "gimmicks"), curriculum soft- 
ware (commercially available reading and arirthmetic "series")., constantly 
varying techniques of impl(^entation, and so on. *Is it any wonder that 
curriculum researchers and program evaluators have had such difficulty in 
^JB^ying to establish credibility of their efforts? One is dealing with a 
continusously varying, highly complex "black box" that no doubt will never 
be successfully addressed by program evaluatioA> efforts. This has been the 
"curse" of the usu^l resource-room evaluation study (e.g., Sabatino, 1971). 
The purpose of the present report is to present the results of a modified 
case-study approach ^that was applied to dne of The first National Regional 
Resource Centers for the handicapped: Tha National Regional Resource Center 
of Pennsylvania (NRRC/P) . ' * 

This report provides data gathered under both self-contained class and 
resource-room conditi<nvs< In both situations, the subjects were learning 
. disabled childj^n. The classes and rooms were spread throughout the spburban 
region ot-^he Greater Philadelphia Area. This report also describes in 

action with the self-contained classes^ the evaluation of the first 
criterion-refgtenced measurement (CRM) systems devised for special education ' 
in both reading and arithmetic: the Individual Achievement Monitoring System 
(lAMS), as it was known in 1971-1972, the time of the data collectiop. 
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The"«eaaing version of the lAMS was revamped several times until it became 
the^rj0<7^conmercially available Curriculum Management System (CMS^Ji^n, Proger, 
Cross, Ewell, Redelheim, & Kalapos, 1975). - ' ^ 

GENERAL METHODOLOGY 

The typical approach to evaluating special education programs in either 
self-contained or resource-room settings"is to gather standardized (norm- 
referenced measurement, or NRM) test data and to generate averages at either 
the class or program levels (see Proger, 1971^> Structured interview feedback 
is also often obtained ftom the professional staff (see Grotsky & Proger, 
1975) and occasionally even students. Finally, perhaps structured pupil 
rating scales, to be completed iy the teacher, are used (Proger, ISysf, /The 
basic dilemma of such group averages, however,* is the usually extreme variability 
hidden by virtue of the averaging process itself. While gtoup-average data ' 
(class level, building level, supervisor level , ^program lever, or whatever) 
Is generally a<rtep<able in normal education where the presun^pttoii of a 
relatively normal curve can be upheld, this is rarely the case in special 
education, no matter what the severity of the handieappdng^^ndltion might be. 

There are at least two^ problems, both interrelated in a distribufion 
sense, that create these severd validity restraints of the data usually coll- 
ected in special education: (a) the extreme variability of handicapped ' 
students of a particular exceptionality ,"^ven when they presumably have been 
grouped in a relatively "homogeneous" fashion (e.g., by age and/or intellectual 
potential); and (b) the skewness and/or kurtosis that often prevail in the 
data distributions of handicapped students. 

What does one do abou.t these problems^ Clearly, the answer is not to 4 
resort to the abolition of data averaging altogether. To the contrary, one 
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DU8t seek additional methods of dat a collecti'On, reporting, and synthesis 
that will compl^ement rather than replace. One such technique is the case- 
study approach, hardly a novel idea in any way, shape, or form. However, to 
apply the case-study approach to handicapped-student data by means of using 
both CRM and NRM measures, and balancing such a reporting format by tfie 
"abominable group averages," iX^erhaps a little unusual, particularly in 

special education. This report will, attempt to illustrate this technique 

\^ 

by applying It to learning disabled children who were being served in self- 

^\ 

contained classes and resource rooms by the National Regional Resource 
Center of Pennsylvania during 1971-1972. In this seitse, the report is a 
type of historical note to the period when CRM was first being looked at, as* 
a, concept in and of itself by special educators (Mann, Proger, & Cross, 1973)/ 

The r^epbrt will proceed as follows. With the reader bearing in mind tlje 
fact that the overall GeStalt of the methodology is a case-study* approach, 
the actual empirical examples will be discussed in two major sectionsi (a) 
Cpi, and (b) NRM. 
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Self-Contained Classes ; There were 29 learning disabled children from 
the suburbs of the Greater Philade|.phia Area. The pupil^s should have been in 
third gr^de but failed second grade and thus exhibited severe learning problems. 
The pupils were screened rigorously by certified school psychologists to ensure 
that at least normal intellectual potential tsra^ present atA t^^ no oth^ handi- 
capping cpnditions were present (such as visual, auditoftsJirJi^^^^ impair- 



ment). The 29 children cam from normal school classes ofMlM^iji^ size and were 



placed irvto 3 special learning disabilities classes 



each cj^ass had a maximum /size of 10. While the sWi^^i^S^^ Is. sm^ll, it must 



be remembered that an enormous amount of datg?4iajl„ ^^|P |^^^rated daily in a 
' Q Vay never before found in classes for the handici 




l^tipnal Project; 



To manage this data in an efficient way, the size of the lAMS field test 
project was del;lberately kept small. The CRM data was gotten only from 
these three classes, since these were the only project sites at which the 
specially developed reading and arithmetic curricular and CRM materials 
were systematically siipervised and data-monitored. *'0f oource, NRM data 
was also collected on these children. See Table 1 for detailed background 
(ID numbers 1 to 40). 

Resource Rooms: There- were 74 learning diM^y^ed^»t^dents enrolled, in 

the National Project resource rooms during ,1971-1972. The) background 

7 ^ . 

characteristics of these children were similar to those in the self- 
contained classes, but the severity of the learning disabilities problem 
was not as great in the resource rooms. See Table 1 for detailed, c^ser 
by-case background data (ID Numbers lOl .to 264). The resource room children 
received a variety of instructional materials and techniques, as' opposed 
to the self-c^talned class children who received the project developed 
reading and mathematics programs. Only NRM data was collected on the 
resource room children. 

♦ 

« « 

INSTRUCTION AL ^ * 

NRM: Thf Widfe Range Achievement Test (Level 1) and' the 1964-1965 ' 
Stanford Achievement Test (Primary Battety I, II) were administered on a - 
pre-post basis to provide normative mea^sures of achievement. For, purposes 
of analysis-, .the data were grouped into temporal categories .according to the 
spans between Ating.«.^ase-study data was the primary emphasis. However, 
mean gain Scores fo^ each group were computed for the subtests in terms of 
the converted grade^uiva'lent scores. Grade equivalents -were used in lieu 
of raw scores^^^^ftW to ascertain a more meaningful significance for the 
layman. 




CRM: For years, teachers have be^n using the strategy ot diagnose, teach 
and ^evaluate: one sees where a child is,' trie$; to take him further, and * 
assesses his progress. The procedure seems to fall into ^nd put- of repute " 
depending upon the "instructionajt moF^s" of the time.' If e<JucatiOnal writei 

* ^ ^ i " %^ , \ t' ^ ' y 

are espousing diagnostic-prescriptive teaching at -the time, then fhe teaiS 
teach-test procedure ia. ".in". On the other hand, if vnrlters are currently t, 
blasting the reliability and validity of teacher-devised tests, then the 
test-teach-test procedure is "out". ' Clearly,^ there is some- truth in. either ' 
position, but as; with most things, compromise is possible and usually highly 
desirable. Mastery learning has entered the educational, scene as such 'h' 
compromise attempt. . . ' ' , 

In essence, mastery learning consists of applying a formalized test- 
teach-test schema to instruction that ±4 based upon a^ careful task analysis . 
of the curricular hierarchy. Instead of u^ing the test-teach-test design to 
instruct the group, the teacher instructs the individual. ^ Accordingly, the 
tests used in this iristructl|?al desigi^^are not scored and interpreted relative 
to the performance of other children/but rather an absolute mastery lev^l. ./^ 
is predetermined for later succesa'in the subject-content ^area. ,;Thus, the 
term "mastery learning."^ This paper ^describes the results obtained by asin^' 
the ^stery learning approach In both reading and arithmetic with gleaming 
disabled children. ^ 

/ To get around the^'usual ^criticisms of teacher-made-te^ts,- and feven / 
moreso to provide teachers, with readily ayailable Measures when they do o t ' 
have time to make, their own, a system of behavioral objectives and /ighly 
specific tests' were*develop^d to accompany the comAerical reading/and 
arithmetic series th^t teachers were using in the project. -(The/approach 
described here^ however , can be applied to any commercially available 
reading program or arif hmetic program and thus has generalliabillty in that s6ns 
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The tesXing^^stem thus developed was^ penned the Individual Achievement 
Jtonitoring System (lAMS) ; also see t|ie most recent version, CMS, devised 
by Mann et al, 1975). * ^ ' 

The original lAMS was an easily used classroom management system 
designed to facilitate day-to-day teacher decisions about instructional 
programing for mentally handicapped children who are taught either in an 
individualized setting or in small groups. No^tter with what p^yticuiar 
curriculum it is employed, the. lAMS. consists of three basic components: (a) 
a series of easily' understood behayioral objectives that map out an instruc- 
tional. program in- any giveh subject-content a'r.ea, (b) a series of tests sthat ' 
parallel the objectives, and- Cc)^^a commercially available program in the"*" ' 
subjecf-content area of interest* The teacher tan Use the -dbjectives in 
mappitig out her instructional p?:ogram on a day-to-<Jay basis. The tests, 
.available to the teacfi^r are designed to^give her a ready-made assessment 
of stud^t achievement ^ifith respect to the selected objectives at any point 
. y\ in time. The* objectives^ and tests of the'lAMS help the teacher make day- 

to-day decisions that are referenced and doded directly with the coni»erical 
\ instructional program being used with the series. " \ 

lAMS draws heavily upon many of the current trends of instructional 
^ V techtiology. Fir^t, there Is a wealth of research to support the premise that 
■ -. , children, benefit from frequent, systematic , testing (see Proger & Mapii, 1973b, 
y ' for a comprehensive review ii this area); not only do f rei^uentlv^iven tests 

provide the teacher -with precise information on how her stu^^nts are 
. ■ progressing academl<^lly, but the -tests also serve as a/a:earning device for 

the students, themselves, -^is phn^ strange indeed ^at handicapped children 
have suffered, frort "test depr^vafc^oji^other thaj/diagnostic placement testing, 
little folldwup testing of the ■^ildren'8>i^Qgre88 is made. Second, the lAMS 
bases its testing program upovLjtheJ2_M^8osS^^ 

.12 . 

/ 
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XCRM). CRM is usually defined in distinction to its counterpart, standardized 
testing* With standardized testing, the individual stjident is pitted against 

group norms; that is, one is interested in comparing a given child's performance 

... • » 

%d.th respect^^to others. On t\e. other hand, CRM provides absolute assessments 
» ^ — — 

of ;a child's performance against f>re-establj.shed standards of mastery; the . 
vchild competes only against these absolute standards in terms of the levels 
' of mastery specified by the teacher. In CRM, the child is compared not to a 

' ' population of children (as with standardized testing) but to a population of 

academic behaviors (see Proger & M^nn, 1973a, for a review of CRM practices 

f ' -.^ ' ^ 

^ in special education) • Thi^d^ the lAMS makes use of ^precisely written behavior- 
• x 

al '«bbj€G^tives to^help the tfeacher specify her inatructioaal goals ,as much * 
as possibl^^sIAMS provides the teacher with prepared objectives rather than • 
asking her to devise her own» ^ - ^ 

The LAMS is an innovative appro^ich, but it is one that enters 
' _ educational scene with much research and development already completed. Ex- 

tensive field testing in applying the approach to one cCTmmercial reading 
series and one commercial arithmetic serieis has beett tarried out ii# the state 
<^ ^Pennsylvania. This field testing is continuously exp^anding. The agency 
through which the 1971-1972 field testing was conducted ia the National ^ 
:Regional Resource Center of Pennsylvania (NRRC/P; later changed to-^he 
NatdonalxieLaming Resource Center, NLRC/P) . Nonetheless, most of the 
developucnt of\the lAMS has been carried out by staff members affiliated with 
the Montgomery County IntermeiJiate Unit, which is an agency separate from the 

r 

National Center. During the 1970-1971 academic year, this staff surveyed the 
state of the art th obJ^ctLves'-based testing systems that could be used with 
' both groups and i^aividuaj^s and did some preliminary work on developing the 
system.^ Initial development of lAMS /including writing the i^istructional ^ 
objectivfes, took place during the ^1971.-1972 academic year. Alsd during that 

ERIC \ '13 .. • 



» extensive field testing took place, which data Is the subject of the 
_t rfeport. 

During the 1971-1972 acadexlilc year, a curriculum-embedded, testln^-and- 
objectlves j:vanagement system was devised* That Is, existing coi^B^erlcal pro- 
grams In given subject areas were selected as models of currlcular^^i^uence* 
Instructional objectives of a speplfj.c, day-to-day type were then wrlttto to _ 
reflect the sequence^ of instruction implied in the commercial program; finally, 
test items were written for each objective. The commercial program's se- 
quince of curriculum was broken down inito ^estimated two-week units of in- ; 
CTruction (referred to as '^modules") . Test items were written for the ob- 
jectives within .each unit of instruction and compiled Into t^st booldets 
(called "monit;ors") . The 1971-1972 model of objectlves-and-testing teacher 
management system was "curriculum embedded", i.e* specific to the curr4.£ulum ' 
used* The same sequence of objectives aiid-\test items could not be use^ with 
different curricula without major chants in sse^ence .and 'additions or 
deletions in content/ \^ . = 

The basic philosophy of the Montgomery County Intermediate Un^t in 



dealing with instruction and rea^iation of handicapped children K^«.^^been 
presented elsewhere (Mann & Phillips, 1967, Mann,' 1969, Mann, 1970; Mann, 1971) 
^^d will be only summarized here. Rather t'han •'f ra,ctionate" a child's 
abilities iftto many isolate "faculties" and then try to build a training 
program to remediate particular deficiencies, Montgomery County (PA) takes the 
view that If basic academic competency in reading and mathematics are necessi- 
ties for functioning In the real world, then reading and mathematics should be 
taught directly. The staff does not believe that training visual perception, 
■otor coordination>^4udltory d^sprlminatlonj sequential memory, etc., will A 
ultlaately have* a benef icial^^png-rAnge impact on the reading and ma^ematlffi 
•kills, • I 
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CRM and, the Reading Program : The reading program selected as appropriate 
to the needs of children vith learning hanfi-rrapg-^j^fi^^a^jT^^ gt-mr ^yrpH — - 
linguistics approach, vith a very systematic treatment of word-attack skills. 
Once a reading program was found that the National Project felt was structured 
enough to handle the chronic academic failure of their handicapped children, 
the next step was to delineate the entire reading program into highly specific 
behavioral objectives. In Table 2, one sees brief descriptive phrases for 
each behavioral objective that was needed for instruction during the first 
year of the lAMS (this table does not, by any measure, reflect the entire 
range of objectives of the lAMS) . It should be noted that Table 2 does not 
contain the bahavioral objectives used by the project, but only the essence 
of 'each objective. The range of objectives in liable 2 is roughly from 
readiness level through the end of second grade. 

After behavioral objectives were written to map out a reading curriculum 
for K-3, test monitors were yrftten to reflecf the objectives and to guide 
instruction. Each test monitor, in general, embodied word attack skills. 
To asisess specific processing difficulties, every at-tempt was made to reflect ^ 
'appropriate combinations -of auditory/vocal and vlsuaiymotor input and output^ 
in each work attack skill. Each monitor also assessed elementary comprehension 
skills in terms of naming a wolrd pres^ted in isolation, Identifying a word 
wh6n presented with two distractors, and identifying proper contextual usage^ 
of words in sentences. Finally, on certain monitors s)natax skills were 
, assessed wheney^r they occurred in the curricular se 

CRM and the Mathematics Program ;" Because the primary academic deficiency 
. of. the children served by the National Project was reading, arwy attetopt to carry 
.out instruction in non-reading areas had to minimize reading problems. Thus, 
a search was undertaken fpr a mathematics program that was structiired^ and yet 
avoided verbiage.^ Table 3 contains brief phrase descriptions taken from 
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more precisely stated behavioral objectives for only that portion of the cur- 
riculum that was needtsd by the particular group of children Involved In the 
1971-1972 field tesf of the IAMS» 'The grade level represented In Table 3 
is^roaighly second grade, since the majt)rlty of children Involved in the first 
year of the lAHS were measured functioning at this level* 

Operational Structure : For any module of instruction, the teacher uses 
a monitor to gauge the child s progress. This monitor can be used in a 
variety of ways. For those teachers who intend to use the system to individual- 
ize instruction, the monitor can be used in a tesL-teach-test fashion* That 
is, after a child takes the first monitor (pretest), the teacher can decide 
which concepts In the unit of instruction the child has already grasped; she 
thus avoids redundant teaching and the child moves on to take the pretest on 
the next module. On the other hand, specifically for those skills the child 
does not have mastery of (as shown by the pretext), instruction is scheduled. 
The child is given a posttest to assess his mastery after instruction; if 
he has not yet achieved mastery, he is given more instruction and then another 
posttest* The cycle is repeated at the discretion of the teacher until mastery 
of the particular unit *ls achieved. An lAMS monitor can serve as a basis for 
intensive diagnostic £ollow-up because it covers both the auditory and visual 
areas in^the reading process. A major benefit of the lAMS monitors is that 
evaluation becomes as much a part of teaching as *the regular* instruction it- 
self. 

The lAMS is not ^^ed as a program to be pitted against alternative 

instriKitional approaches and thtts evaluated in a formal research design. 

Rather, the lAMS is A method of gathering data on any instructional program^ 

Such data is to be useas^rimarily as a meatis for the teacher to make day-^to 

day instructional decisions for the individual child. Thus, the data con- 

* 

tained In the present report is to be considered &ore descriptive In nature 
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than comparative/ Judgmental. ,There is no control group'^^as such in the 
present study. Rather, the children serve as th^ir own ^<:ontrols. In'effec7, 
^he lAMS has been applied to a group of learning disable^ children who were 
complete academic failures in reading and mathematics in ^raditional in- 
structional settings; the pupils had shown no gains 'in eitjier of these-two 
areas during the previous academic year (1970-1971) . Hence, if the average 
child performance could be raised even a half of a grade level, the LAMS 
might be deemed effective. 



ILLUSTRATION OF TfiE 
MODIFIEi)- €ASE-STLT)Y 
APPROACH: NRM DATA 



In Table 1, the reader sees at a glance the nature of the case^study 
approach. All childrec/ are presented in anonymous fashion, as would be' 
required by confidentiality (see Fisctenan & Proger, 1975). xhe reader of 
Such a report is forced to focus in on the great degree of variability 
present in ^h handicapped-child data and hopefully not make any sweeping 
generalizations, which is unfortunately what usually happens when group 
averages are given. , ' ^ 

However, even the present investigators would have to admit ^t hat case- 
by-case presentation^ often lead one to asking for a quick "feeling" of what 
the general trends were. Thus, in Table A the "group-averages approach" is 
presented for both self-contained classes and for resource rooms. The point 
to be made, .however, is tKat the data in Table 4 |re. b^onsidere^ secondary 
to the data in Table 1. In any program interpretation report of such group- 
averages data as in Table A, severe restrictions' must be stated in no uncer- 
tain terms; such qualification is virtually never done. « 
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ILLUSTRATION OF THE 



KODIFIED CASE-STUDY 
APPROACH: CRM DATA 



To see just how the lAMS can JVonitor" a. child's performance thoughout 
the year, the performance of the child ^^18 (one of the slower students) has 
been plotted in Figure 1, The mastery Ifevel is given along .the vertical axis 
in terms of percent correct, while the objective number (refer to^ Table 2 
for descriptions) is given along the horizontal axis.. In mastery learning, 
one is Interested in giving heavy instructional efforts to those objectives 
the child has done poorly on with "the pretest, and on the other ha^ avoiding 
those objectives the child already demonstrates mastery on. For child #18, 
little instruction^ is: nepessaty. OTt the first' 10 objectives, for objectives 60 
to 80, 95 to 115,, and 130 to 145. H)>wever, over the rest of the range of 
cutricular content, the chi\d needed at\least partial instruction. 
^\^^Typical casft-study prof iles' tould be pigtted for various types of 
childrW^^^iigh-IQ vs. low-IQ, severe reading deficit vs. ^derate reading 
deficit, and $o <5n.„ Such objective-by-^ objective data gives a longitudinal 
pase-study view .of how a jiven handicapped child is progressing. In^fact, one 
can consider Figure 1 to be a poss;Lble CRM-oriented report card. Thus such a 
document can not only be used^at the program evaluation level (in a case-study, 
graphical fashion), but can al^ s^rve as the top^ic of discussion for parent' 
conferences. ^ 

Just as with the NRM illustration above, the investigators also feel a 
group-average graphical approach is of ^alue, if properly qualified . Figure 
2 shows objective-by-objective progress in reading of the 29 self-contained 
class children over the course of the school year (again, a longitudinal 
study). Figure 3 shows similar information for arithmetic. In both cases, 
* the objective codes can be deciphered by referring to Tables 2 and 3, 
respectively. 
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FOOTNOTES 

1 • 

The preparation of this paper was aided by two grants to federal 

projects for which the Montgomery County Intermediate Unit is the local 
education agency: (a) Pennsylvania Resources and Information Center for 
Special Education (ESEA Title III: R-22-H, 48-70-0003-0), and (b). 
National Regional Resource Center of Pennsylvania (ESEA Titles VI and III: 
OEG-2-70-0051; 48-1919-SC-^99) . Howfever,,the views contained herein are 
solely thos^e of the authors and no endorsement on the part of Montgomery 

County, PRISE, NRRC/P, k>r the U.S. Office of Education, is'to be inferred. 

2 ' , • 

The investigators were greatly assisted in the development of modified 

curriculum materials and CRM exercises by Ronald Brown, fttfrry A. Freedman, 

?aul ^ode^ and Marilyn Fitzgerald, Paul S. Redelheim, and Bruce Bischoff. ^ 

3 ' . ' * . ^- ' 

The reading program Con^^ts of Prebook through Book 20 of Steps 

in Reading by Glim (19&Q). ^This series is also referred to as the Palo 

r 

Alto Reading Program (1st ed.) - 

^The aathematics program consists of the Mathematics Readinesa Kin- 
dergarten Book and the Mastering Mathematics 'Books A, and B_ from 
Sadlier Publishing Company (1969-1970). 
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TABLE 2 (PART 1) 

LIST OF^ READING OBJECTIVES: 

ORIGINAL NUMBERING AND 
EXPERIHENTAL (NEW) NUMBERING 



Monitor 
Number 



Monitor 

Original 

Number 



New 

Objective 
Number . 



DESCRIPTION 



1 
2 
3 
A 
5 
6 
7 
1 
2 
3 
1 
2 
3 
4 
1 
2 
3 
4 
5 
6 
1 
2 
3 
1 
2 
3 
1 
2 

' 1 
2 
1 
2 
3 
1 
2 
1 
2 
1 
2 
1 
2 
3 
l- 
2 
1 



1 
2 
3 
4 

5 

•6 

7 

8 

9 
10 
11 
12 
.13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 ' 
25- 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43. 
44 
45 

46 
47 



Sound , symbol relationship^ of, the letter A 
Sound symbol relationship qf the letter M 
Sound symbol relationship of the letter R 
Use of " I am". "Am I" ' ' 
Sound symbol relationship of the letter T 
4Jse" of Capital letter* and the. period .^nd .quesiion mark 
Vocabulary usage 
Vocabulary usage 
Usage of the comma 

Sound sumbol relationship of the letter S 
Syllablication 

Sound s3nnbol relationship .of the letter N 

Vocabulary usage 

Usage of question marks 

Sound sjnnbol rela.tionship of the letter L 

Vocabulary usage 

Sound symbol relationship of the letter F 
Sound symbol relationship --of {he letter B 
Usage of the exclamation marx 
Sound symbol relationship of the letter 0 
Sound symbol relationship of the letter H 
Vocabulary usage 

Sound symbol relationship of the letter G 
Sound symbol relationship of the letter V 
Vocabulary usage 

fitjund symbol' relationship of the letter D 
Sound symbol relationship of the letter I 
Vocabulary usage 
Vocabulary usage , 

Sound sjnnbol relationship of the letter Z 
Sound symbol relationship of the letter K 
Vocabulary usage 

Sound symbol relationship of the letter W 
Sound symbol relationship of the letter P 
Vocabulary usage 

Sound sjnnbol relationship of the letter U 
Vocabulary usage 
Vocabulary (isage 

Sound symbol relationship of the letter C 
Sound sjnnbol relationship of the letter Y 
Vocabulary usage 

Sound symbol relationship of the letter J 

Sound symbol relationship of the letter E 
Vocabulary u&age 

Sound symbol relationship of th^ ^ett^r X % 

Vocabulary usage , 
'Soond symbol relationship of the letter Q 
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TABLE X (PART 2) 



LIST OF READING OBJECTIVES: 

ORIGINAL NUMBERING AND 
EXPERIhfENTAL (NEW) NUMBERING 



Monitor 

Original 

Nunber 



New 
Objective ^ 
Number 



3ESCRIPTI0N 



i 



1 

2 
3 
A 

5 
1'- 
2 
3 
4 

5 
tl 
2 
3 
4 

5 
1 
2 
3 
1 
2 
3 
1 

2 
3 
1 
2 
3 
1 
2 
3 
1 
2 
3 
1 
2 
3 
4 
5 
6 



48 
49 
50 
51 

53 
54. 
55 
56 

57 

58 

59' 

60 

61 

62 
63 
64 
65 
66 
67 
68 
69 

70 
71 
72 
73 
74 
75 
76 
77 
78 
79 
80 
81 
82 
83 
84 
85 
86 



Beginning "L" consonant clusters 

Identification and usage of familar pattern endings 
Rhyming 

Usage of beginning "L" consonant clusters with familiar 
pattern endings 

Vocabulary usage , . , • . . * . 

Beginning "r'*' consonant clusters 

Identification & usage of familiar" pattern, endings 

Rhyming ' ' 

Usage of beginning "R" ttfnsonatAt clusters with familiar 

pattern endings * 

Vocabulary usage 

Beginning. "S" and "TW" consonant clusters ^ 
Identification & usage of familiar pattern endings 
Rhyming , ■ , 

Usage of beginning "S" and "TW" consonant clusters with 
familiar pattern endings 

Vocabulary usage _ ' 

Identification and usage of ending consonant clusters (nd, st) 
Rhyming 

Vocabulary usage 

Identification & usage of the ending consonant clpster- "NT" 
RKyming 

Vocabulary usage 

Identification and usage of ending consonant cluster 
(mp, sk, ^, Ip, Ik.,, id, ft, pt) 
Rhyming ' 
Vocabulary usage 

Identification & usage" of double ending consonants (1 J., ss,zz) 
Rhyming 

Vocabulary usage ^ 
Identification & usage of double ending consonants (11, ss) 
Slhyming ^ ' ■ ' . ' 

(/oca^ulary usage 

Sound symbol relationship of long e speljed "E" & "EE" 
Forming regular plurals 
(Vocabulary usage 

Identif icatjon & usage of A-consonant - E patterns 

Identification of Che silent E 

Vocabulary q,sage 

:^ntractions and abbreviations 

Ldentif ication & usage of e-consonant - e patterns 
Subject - v^rb agreement- "rs" "are" "was" "were" 
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TABLE 2 (PART 3) 



LIST OF READING OBJECTIVES: 

QRIGINAL mraERING AND 
EXPERIKENTAL (NEW) NUMBERING 



Monitor 
number 



Monitor 

Original 

Number 



New 

Objecti'<re 
Number ' 



DESCRIPTION 



27 



28 



30 



31 



32 



33 



3A 



35 



ERIC 



1 

2 
3 
4 

1 
2 
3 
4 
5 
1 
2 
3 
1 
2 
3 
4 
5 
6 
1 
2, 
3 
4 
5 
6 
7 

i 

2 
3 
4 
5 
1 
2 
3 
4 
5 
1 
2 
3 
A 
5 
1 
2 
3 
1 



87 
88 
89 

'90 

•9t- 
92. 
93 
94 
95 
96 
97 
98 
99 
100 
101 
102 
103 
104 
105 
106 
107 
108 
109 
110 
111 
112 
113 
114 
115 
ll(r 
117 
118 
119 
120 
421 
122 
123 
124 
125 
ft6 
127 
128 
129 
130 
131 



in the mediill position 



sltj 



^ound symbol relationship of 
Vocabulary usage 

Identification and u.age of "ee" words 
Usage of familiar beginning consonant clusters with A- 
fc ^jp spj^antjs - E t pat^t^^rns,, ^ . ' . , ' - r 

Usage of "Place where prepositions" 
Subject verb agreement-present tense 
Vocabulary usage 
1 consonant - e- pattern 
Identification of the silent e 
Identification and formation of compound words 
Identification & usage of plurals with "S" sounds as /s/ 
Identification & usage' of plurals with "Z" sounded as /Z/ 
Vocabulary usage 

Sound symbol relationship of short "c" 
Funhtion of the Signal e 

Identification usage of O-conson^^nt _E patterns 
Sound symbol relationship of 0-consonant, E-pattern sounded as 
Sound symbol relationship of O-consonant, E sounded as /z/ 
Vocabulary usage ; , 

Identification and usage of G-consonant e pattern 
Sound symbol relationship of "0" as in /love/ 
Sound symbol relationship of "0" as in /move/ 
Vocabulary usage 
Usage of past tense 
Exceptions to the signal "e" rule 
Sound symbol relationship of VO" as in /gone/ 
-Identification & usage of ^-consonant - E patterns 
Identification of the signal E 
Sound symbol relationship of U as in Hubel 
Identification & usage of short "M" 
Vocabulary usage* ** 

Identification & uskge of the /are/ pattern 
Identification of exceptions to the /are/ pattern 
Identification and usage of the /ore/ pattern • 
Sound symbol relationship of consonant digraph* "sh" 
Vocabulary usage 

Plural formation by adding "s" or "es" 
Sound symbol relationship of "o" as in /go/ 
Sound symbol relationshlp^of "o" as in /do/ 
'Sound symbol relationsljip of consonant digraph /th/ 
Vocabulary usage ' 
Sound symbol relationshi}) of "oo" as In too 
Sound symbol relationship of "oo" as In good 
Vocabulary usage r <♦ 

Usage of /ed/ sounded as /4/ 



•32 



Proger 



TABLE 2 (PART 4) 



LIST OF READING OBJECTIVES: 

ORIGINAL NITMBERING AND 
EXPERIMENTAL (NEW) NUMBERING 



Monitor 
Number 



Monitor 
Original 

Number 



New 

Objective 
Kwnber 



DESCRIPTION 



37. 



38 



40 



41 



42 



43 



2 
3 
4 
5 
1 
2 
3 
1 
2 
3 
1 
2 
3 
1 

3 
1 

.2 
1 
2 

3 
1 



132 
133 
134 
135 
136 
137 
138 
139 
140 
141 
142 
143 
144 
145 
146 
147 
148 

149 
150 
151 

152 
153 



Sound Symbol relationship of consonant digraph "wh" 
Usage of /ed/ sounded as /t/ 

Identification of /e<^/ as signifying past tense > 
Vocabulary usage ^ y> 

Sound-symbol relationship of cons'ofiant 'digraphs' /cft}*^ & /th/ 
Vocabulary usage 

Formation of' plurals by adding s and "es" 
Identification of /ed/ sounded as /d/ or /t/ 
Usage of "ed" sounded as /id/ 
Vocabulary usage 

Sound symbol realtionship of consonant digraphing "ng" ^ 
Sound symbol relationship of consonant digraph "nk" 
Vocabulary usage 

Sound symbol realtionship of "ck" 
Formation of plurals by adding "es" 
Vocabulary usage 

Formation of "cd" words which require doubling the final 

consonant 

Vocabulary usage 

Usage of the "ing" ending 

Formation of "ing" words which require. doubling the final 

consonant 

Vocabulary usage 

Sound symbol relationship of "or" 
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TABLE 3 (PART 1) 



LIST OF MATHEMATICS OBJECTIVES; 
^ ORIQINAL NUMBERING AND 
EXPERIMENTAL* (NEW) NUMBERING 



Monitor 
Original 

NuHjber 



New 

Objective 
Number 



DESCRIPTION 



1 

2 

3 

4 

5 

6 

7 

1 

2 

3 

4 

5 

6 

7 

1 

2 

3 

4 

5 

6 

1 

2 

3 

4 

5" 

6 

7 

1 

2 

3 

A 

1 

2 

■ 3 
4 
1 
2 
3 
A 
1- 
2 

> 3 

1? 



1 

2 
3 

. 4. 

5 

6 

7 

8 

9 
10 
11 

i2 

13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 

ii 

32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43 
44 
45 
46 



& open number sentences 
quarters 



Identification of sets and subsets 
Identification and usage of numerals 1-10 
One-to-one correspondence of sets 
Identification -and* usage of inequality sj^oJ-S 
Concept of zero and the empty set 
Counting by units, and 2*s 1-20 
Usage of a final number name 
Partitioning of sets 

Missing addends - % 

Ideintif ication & usage of true, falae. 
Coin values - pennies, dimes, nickels. 
Counting- to ten 

Single digit subtraction facts 
Commutative property of addition 
Sums of 11 and 12 

Subtraction with minuends of 11 and 12 
Identification of days of the week 
Identification ,of month of the year 
Constructing a bar graph 
Plotting points, figures 

Addition and subtraction facts through 18 ^ 
Commutative and associative properties of addition 
Solving single digit addition problems in several forms 
Subtracting " to a ten" 
Number families - single dig^t numbers 
Solving sums through 18 menially 
Keeping score with single digits 
Counting from l-uOO by unitsiand tens 
Expanded notation - five digit numbers 
Telling time to* the hr. and half hr. 

Identification of circle, square, rectangle, and triangle 
Fractions: h 

Number families: two digit numbers 
Addition and subtraction of two uigit numbers to the decade 
Greater than, less than relationa^hip of a two digit number 
Solving number puzzles 
Coin values - up to half dollar 
Fractions: h 

Temperature - comparing and" graphing 
Identification of odd and even numbers 
Addition and Subtraction of 10 *s 
Two digit addition 

Linear measurement - feet and inches, 
Repeated addition sets of 2 
Repeated addition sets of 3 
Rounding to the neatest ten 
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TABLE 3 (PART 2) 



LIST OF MATHEMATICS O'BJECTIVES; 

ORIGINAL* NU>fflERING AND 
EXPERIMENTAL (NEW) NUMBERING 



Monitor 
!;uinber 



Monitor 
Original 

Number 



New 
Objective 

Number 



DESCRIPTION 



11 



12 



7 



lA 



15 



15 
16 



17 



18 

ERIC 



3 
A 
1 
2 
3 
1 
2 

• 3 
A 
1 
2 
3 
A 
1 
2 
3 
A 
1 
2 
3 
A 
5 
6 
7 
8 
1' 
2 
3 
A 
5 
1 
2 
3 
A 
5 
6 
7 
8 
9 

10 
1 
2 
3 
4 



A7 

A8 

A9 

50 

51- 

52 

53 

54 

55 

56 

57 

58 

59 

60 

61 

62 

63 

64 

65„ 

66 

67 

68 

69 

70 

71 

72 

73 

74 ' 

75 

76 
>77 
W8 

79 . 

80 

81 

82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 



Regrouping 10' s - two digit algorithm 
Identification of syTm.i6tricar shapes 
Identification of Roman Numerals J 1-10 
Fractions 1/3 

Linear measurement: whole jand fractional inch units- 

Two digit subtraction algorithm 

Repeated addition: sets of 4's 

Place value: units and tens 

Coin values: making change " 

Liquid measurement: cu"p, pint, quart 

Expanded notation: two digit numbers 

Introduction of Roman numerals: 11-20 

Addition of 2 digits with 3 addends 

Multip],ication by fives 

Missing factors: multiples of 5 

Commutative property of multiplication 

Measurement: dozen, half dozen 

Fraction' of a set: 

Fraction of a set: h 

Identification of odd or even numbers and their sums 
measurement : weight -» . 

Measurement: pound and half poind 
Addition on the number line-multiples of 5 
Subtraction of the number line - multiples of 5 
Word problems: J5 and H r ^ ■ • 

Abbreviations ^or familiar units of measure 
Place valiie; units, tens, hundreds 
Talking t^ime: half and quarter hour 
Addition tables 

Associative property of addition 
Solving incomplete subtraction problems 
Addition of one digit nos. - three addends 
Identification of subsets 
Inec^ifalities - single digit combinations 
Identification of sets 
Multiplication: multiples of 2 ' 
Commutative property of multiplication 
Division symbols and algorithms 
Division: DLvisor of 2 

Number families: Division and Multiplication 
Multiplication: Multiples of 3 

Division: divisor of 3 ' ** 

Regrouping algorithm 
Writing dates and their abbreviations 
Figure representation of fractions: J5, 1/3, H; 
Fractions: numberline values halves, thirds, fourths 
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TABLE 3 (PART 3) 



UST OF MATHEMATIC OBJECTIVES: 
ORIGINAL NUMBERING AND 
EXPERIMENTAL (NEW) NUhffiERING 



Monitor 
S'umber 



Monitor 

Original 

Nunber 



New 

Objective 
Number 



DESCRIPTION 



19 



20 



ERIC 



5 
1 
2 
3 
4 
5 
6 
7 
1 
2 

3 • 
4 
5 
6 
7 
8 
9 
10 



93 
*94 

95 
96 
97 
98 
99 
100 
101 
102 
103 
104 
105 
106 
107 
108 
109 
110 



Number scores 0-1 OQ 

Multrttdlcation :- multiples' of 2 

Division - Divisors, of 2 

Fraction of a seL; h 

Coin values up to one dollar , 

Multiplication: mu^^les of 3 

Division: Divisorif- of*'3 

Fraction of a set: 1/3 

Identification of simple curves 

Identification of open ^nd closed curves 

Number sequence 0-100 j. 

Multiples of 100 between^' and 100 - 

Multiples of 10 % 

Subtraction: Z digijt. numbers even decades 

Nujnber families - 2 digffnumbers 

Place value - units, teti, hundreds. 

Addition: regroup?.ng tens 

Subtraction - regrouping tens 



/ 



. 36 



Proper 



31 

9 



TABtfe A. 

BACKGROUND VARIABLE MEANS AND 
• MEAN GAINS ACHIEVED UNDER 
' SELF-CPNTAINED AND 
RESOUkCE ROOM APPROACHES 



Variable 


a* 

Self-contained 

— ^ '■• , 


Resource Rooni " 




Descriptive Background Data 




Chronological Age 


102.00 


108.30 


wise Verbal IQ 


100.50 . 


97.32 


Wise Performance IQ 


100. 5A 


97.30 


Wise Full-Scale IQ , 


101.07 


97.00 


Gain Data 


WRAT Spelling 


0.8A 


0.95 ^ ^ 


VRAT Arithmetic 


0.70 


0.95 


WRAT Seadiitg 


l."32 


1.36 


SkT Word Reading or 

Word Meaning v 


\^J^^ 0.8A 


0.71 


SAT Paragraph Meaning 


1.00 


0.80 


^AT Spelling 


l.OA 


0.6A 


SAT Word Study Skills 


1.28 


0.87 


SAT Vocabul^y/Language 


0.93 


0.69 ' 


SAT ArilfhmeticMrithmetic 
Coi&putation 


0.83 


0.67 


SAT Arithmetic Concepts 


1.31 


a. 15 


SAT Science & Social Studies 


1.16 


0.65 
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Cpntlhu^on of Table 4 



Note. — Gain data is given in grade-equivalent scores. . 

®N»29 except in, cases of missing data (see Table 1^, I.D. Numbers 1 to. 40., to 
determine exact N for any given subtest) ' « / 

>N»7« except in. cases^^^;Lssing, data j(6«e .Tablcv I.D;-Nutift>ers 101 ta 264, to 
determine exact N for any given subtest) 
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